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Gradient flow for controlling quantum ensemble 

Ruixing LONG Herschel RABITZ 



Abstract — We propose in this paper a gradient-type dynamical 
system to solve the problem of maximizing quantum observables 
for finite dimensional closed quantum ensembles governed by the 
controlled Liouville-von Neumann equation. The asymptotic be- 
havior is analyzed: we show that under the regularity assumption 
on the controls the dynamical system almost always converges 
to a solution of the maximization problem; we also detail the 
difficulties related to the occurrence of singular controls. 



I. Introduction 

Quantum control is concerned with actively manipulating 
physical and chemical processes on the atomic or molecular 
scale where quantum mechanics is the rule. The origin of 
quantum control goes back to the early attempts to use 
lasers for selectively breaking molecular bonds, and several 
approaches using quantum interference, adiabatic passage, 
pump-dump control etc. have been proposed since 1970's. 
For the historical development of quantum control, the state 
of the art from both theoretical and experimental points of 
view, and open research directions, see for instance the recent 
review paper Ql ■ An overview on control techniques applied 
to manipulating quantum systems is also given in ifTTl . More 
detailed treatment from a control theoretical point of view 
can be found in (9). Among existing methods for controlling 
quantum systems, optimal control theory plays a major role. 
The key point is to develop control strategies in a constructive 
way such that a certain performance index, or cost functional 
is optimized under the constraints imposed by realistic experi- 
mental conditions. Three classes of problems - state transition, 
observable maximization, and unitary transformation- have 
been attracting the most attention in the community 0, |23l . 
The performance indices in these problems only depend on the 
final states of the corresponding quantum systems, although in 
full generality time or energy consumption could be taken into 
account as well (see for instance IfTTl . l20l . J6|). Moreover, 
these performance indices can also be used as Lyapunov 
functions in closed-loop feedback designs for stabilization or 
trajectory tracking, see |29l , 1221 . |f2TJ, 0, l28l and references 
therein. In this paper, we only consider the problem of max- 
imizing quantum observables for closed quantum systems, an 
open loop strategy will be proposed. The analysis also extends 
to state-transition and unitary transformation problems. 

For a closed n— level quantum system, the evolution of its 
density matrix p(t) under the dipole moment approximation 
is described by the following time-varying Liouville-von Neu- 
mann equation: 

p(t) = [fT t€[0,T], 
P(0) = Po, 
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where po is the initial density matrix which is assumed to be 
Hermitian, the traceless skew-Hermitian matrices Ho and Hi 
are respectively the free Hamiltonian of the system and the 
dipole moment. The vector space of traceless skew-Hermitian 
matrices will be denoted by su(n). We assume that the 
admissible controls u are elements of H := L 2 ([0, T],M). This 
corresponds to the ideal case where the intensity of the external 
field u(-) is not constrained. The vector space T~L equipped 



with the standard inner product (u, v)u 



u(t)v(t)dt, for 



(u, v) G % x %, is a Hilbert space. The corresponding norm 
will be denoted by || • 

It is well-known that the solution of (HJ is given by 



p(t) = U(t) Po U(t)\ 
where the propagator U(-) satisfies 



U(t) 
U(0) 



(H 
Id. 



■u{t)Hi)U(t), t£[0,T], 



(2) 



(3) 



Since Ho and Hi belong to su(n), U(-) is a curve in the 
special unitary group SU(n). Recall that SU(n) is a compact 
Lie group and its Lie algebra is su(n). Eq. (0 implies that p 
evolves in a subset of the unitary orbit of po defined by 

O{po) := {UpoU\ U e SU(n)}. 

We assume from now that the system (0 is controllable, then 
the state space of p is equal to O(po) and the system (Q]i 
is controllable in the sense that all points of O(po) can be 
reached from po by choosing suitable controls. 

Remark LI. For T large enough, a necessary and sufficient 
condition for (01 to be controllable is that the Lie algebra gen- 
erated by Ho and Hi is equal to su(n). This is a consequence 
of the controllability results on general Lie groups obtained 
by Jurdjevic and Sussmann in fl6l. See l24l, fl2l. l25l. or l9l 
Ch. 3] for controllability of quantum systems. We also note 
that the set of pairs (Ho, Hi) such that Ho and Hi generate 
su(n) is open and dense in su(n) x su(n) (cf. lfl5l Th. 12, 
Ch. 6, p 188]). 



Define the end-point map for (HJ as 



End Po(') 



H 

u 



O(po) 
P(T) 



In this paper, we are interested in the following maximiza- 
tion problem: 

Problem 1. Let 9 be a Hermitian matrix. Find it max £ % 
maximizing the cost function 

J(u) := Re tr(End po (u)6>), for u E U. (4) 

Remark 1.2. 9 represents an observable for the quantum 
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system and \x(p(T)9) is the average of different possible 
results given by the measurement of 9 at time T (cf. JU 
Chap 3-E]). Problem 1 consists in finding a control field u 
maximizing this average. 

This problem is closely related to the two following prob- 
lems. 

Problem 2. Let 9 be a Hermitian matrix. Find p max G O(po) 
maximizing the cost function 

J(p) := Re tr(>0), for p G O(p ). (5) 

Problem 3. Given an arbitrary target state p final G O(po), find 
w final G U such that 

End po (u final ) = p final . (6) 

Remark 1.3. The compactness of O(po) guarantees the ex- 
istence of solutions for Problem [2] which in turn implies, 
together with the controllability assumption, the existence of 
solutions for Problem [T] 

Remark 1.4. If we are able to find p max a solution to Problem 
E] then Problem[I]is equivalent to Problem [3] with target state 
equal to p max - We also note that u is a solution to Problem 
Q] if and only if End Po (u) is a solution to Problem |2] 

We discuss in this paper a gradient-type dynamical sys- 
tem to solve Problem 1. The method is well-known in the 
quantum chemistry and NMR (Nuclear Magnetic Resonance) 
communities (see for example 0141 . 0, ED). We give here a 
rigorous mathematical formulation of this method as well as 
analysis on its asymptotic behavior. We also formulate some 
open questions related to the presence of singular controls for 
(Q3. The paper is organized as follows. We recall in Section ITT1 
classical results on the geometry of the unitary orbit O(po) and 
derive some computational lemmas related to the end-point 
map. The main results of this paper concerning the asymptotic 
behavior of the dynamical system are presented in Section Hill 
Finally, concluding remarks are formulated in Section [IV] and 
Appendix deals with a technical proof. 

II. Preliminary results 
A. Geometry of the unitary orbit 

We summarize in this paragraph some results on the ge- 
ometry of the unitary orbit O(po). The key point is to define 
a suitable Riemannian metric on O(po). Add references. The 
presentation here follows l26l Section 3.4.4]. 

Recall that O(po) is a compact connected submanifold of 
C nx ™ isomorphic to the quotient space SU(n)/H, where 

H := {U G SU(n), Upotf = P o} 

denotes the stabilizer group of po. We have 

dim O{p ) = n 2 - 1 - dim H := N. (7) 

The tangent space of O(po) at p = Adjjpv := U PqU^ is 
given by 

T p O{po) = ad p su(n) = {ad p O, Q G su(n)}, (8) 
with ad p f2 := [p, fl] := pVt — Hp. 



Remark II.l. Since the adjoint map Adu : O >-» Ad^fi 
defines an automorphism on su(n), the tangent space T p O(po) 
is also equal to {ad p Ad[/0, O G su(n)}. 

In order to define the gradient of the cost function J, we 
first need to equip T p O(po) with a scalar product. Note that 
the kernel of ad p : su(n) i— > C" x ™ is given by 

I) := {n Gsu(n), [p ,Q] = 0} 

and forms the Lie subalgebra to H. By the standard Hilbert- 
Schmidt scalar product (ili,^) *-> tr(Q|f22) on su(n) one 
can define the ortho-complement of f) as 

p := {fii G su(n), tr(f4fi 2 ) = 0, for all 2 G h}. 

This induces a unique decomposition of any skew-Hermitian 
matrix O = & + W with & G f) and W G p. 

Definition ELI. For p = Adup with U G SU(n), we define 
a scalar product (•, -) p on T p O(po) by 

(ad^Adc/Oi), ad p (Ad [/ fi 2 )) p := tr(fifoP), (9) 

which is equivalent to 

(adpfii.adpna^ := tr(^ pt ^ p ) (10) 

with p p := Adjyp. 

A fundamental property of the Riemannian metric defined 
above is it is Adsu(")— invariant, i.e., V £, r\ G T p O(po), and 
V U e SU(n), 

(t, V) P = (Adu^, AduT]) AduP . (11) 

For later use, we recall the following result. 

Proposition II.l (Theorem 3.16 ll26l ). Let J be the cost 
function considered in Problem [2] and p G O(po), Then, 
the gradient of J at p with respect to the Riemannian metric 
defined by Eq. (O is given by 

VJ(p) = [p, [p,9]}. 

Furthermore, p c G O(po) is a critical point of J if and only 

if 

\p c ,e] = o. 

Remark II.2. Let d,J(p) be the differential of J at p. Then, 
by definition, we have 

Vr ? GT p 0(p o ), dJ(p)r l = (VJ(p),r 1 } p . 

We note that the expression of the gradient depends on the 
metric chosen for T p O(po). One can choose metrics other than 
the one defined by (0, for example, the induced Riemannian 
metric if we consider O(po) as a submanifold embedded in 
C nx ™. However, the invariant metric defined above gives a 
simple expression of V J. 

In order to simplify the discussion, we assume that 
(HI) the initial density matrix pg and the observable O both 
have simple eigenvalues. 
The following result is a direct consequence of Proposition 
Unjand (HI). 
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Corollary II.2. Under (HI), J has M := n! isolated critical 
points in O(po). 

Let {pi}i=i,...,M be the critical points of J such that 
J(pl) < ■■■ < J(pm). For i = 1, . . . , M, let V 2 J(p.O be 
the Hessian of J at pi. 

Lemma O.3. Under (HI), for i = l,...,M, V 2 J(p 4 ) 
is non-degenerate. Moreover, V 2 J(pi) is positive definite, 
V 2 J(pa/) is negative definite, and V 2 J(pi) is not definite 
for i = 2, . . . , M - 1. 



Lemma III. 31 states that J only has one minimum and one 
maximum, all other critical points are saddles. The proof is a 
straightforward adaptation of the one for Iil3l Th. 1.3, p 52]. 
See also l26l Cor. 3.8] and its proof. 

B. Differential of the end-point map and its adjoint operator 

The end-point map End po (■) is C°° (in fact analytical in our 
case). For u G 77, the first derivative of End pn at u is given 
by 

A I \ ^ ^ T End P0 (u)O{p ) 

dEnd po (u) : ™ , (12) 

v \-> dEndp (u)v = y v (T) 

where, for every v G 77, y v : [0,T] H> TO(po) is the solution 
of the variational equation 

y(t) = [flo + «(t)5i,y(t)]+t;(t)[Fi,p(t)], ie[0,T], 
2/(0) = 0, 

(13) 

with p(-) denoting the solution of (Q3 associated with the 
control u. The following computational lemma is obtained by 
variation of constants. 

Lemma OA If [/(•) : [0,T] ^ SU(n) satisfies 

U(t) = (H +u{t)Hi)U{t), t£[0,T], 
17(0) = Id, 

then, y,(-) : [0,T] ^ TO(p ) given by 

y v (t) = [/(t) / [CTt (5)^1/^), U(tY (14) 
7o 

is the solution of (TOT l. 

Corollary II.5. There exists a contant C* > depending on 
Po, Hi, T such that for all u G 77, we have 



Definition II.3. A control u 6 77 is called singular if the 
rank of <iEnd po (u) is smaller than the dimension of the state 
space O(po). The corresponding trajectory is called singular 
trajectory. The co-rank of a singular control u is defined as 
equal to 

dim O(po) — rank (<7End po (u)). 

Remark II.3. The notion of regular and singular controls will 
play a crucial role in the convergence analysis of the gradient 
flow, see Section [Till for more detail. 

Definition II.4. Given m£H, let p(-) be the solution of 

P (t) = p(*)], ie[0,n (16) 



p(0) = Po- 
The adjoint equation along p(-) is defined by 

q{t) = [H Q + u(t)H u q(t)], te[0,T], 



(17) 

q{T) = q T , 

for some qT G T p ( r )0(po)- The solution g(-) of Eq. ( TFTb is 
called adjoint vector. The corresponding switching function 
®Po,q T (:) is defined by 



*Po,gr(*) : = (?(*), [-ffi,P(i)])p(t), 



(18) 



where the Riemannian metric ( , ) p m is chosen to be the one 
given in Definition lII.il 

Lemma II.6. For qr £ T p ( T jO(po) an d v G 77, we have 

(g T ,dEnd po (u)w) p(T) = ($ Po ,g T , v) n . (19) 
Proof of Lemma 1/7 61 
(<7T,dEnd po (u)v) p{T) 

= (qr, U (T) / [[/(^t^C/^.po^^ds f/(T)t) p(T) 
7o 

{ gT ,c/(r)[c/t( s )H lC/ ( s ) ; p ][/t( r) ) KT)t; ( s)ds . 

Since the Riemannian metric ( , } p ( t ) is Adsu— invariant, 
we have 



^„,,rW = («(*)» [fli.P(*)]},(t) 

= ( Adm T _ t) 9(f), Ad,7 (T _ f) [#!,,£>(«)] 



/Ad 



U(T-t) 



P(t) 



|dEncU,(u)v|| < <5|M|«, V w £ 77. 



(15) 



Proof of Corollarv \II.5\ It suffices to note that there exists 
a constant C\ > such that 

||z(*)|| < Cill^lk. for a11 t e [0,T], and it £ 77, 



where z(t) = / [U^ (s)H 1 U(s), p ]v(s)ds. 



= (q T , U{T-t)[H uP {t)]U{T-t)^) p{T) 

= (q T , U(T)[U{tfHiU(t), po]U{T)i) pm . (20) 

This implies (q T , dEnd Po (u)v) p{T) = {§ Po , qT ,v)u- ■ 

Definition II.5. The adjoint operator dEnd* o (it) of dEnd Po (u) 
is defined as the unique operator satisfying 

(z, rfEnd po (u)w) Endpo {u} = (dEnd* o (u)z, v) H , 

for all z £ T Bnd , u) O(p ) and w £ 77. 



Definition II.2. A control u G 77 is called regular if the 
rank of dEnd po (w) is equal to the dimension of the state 
space O(po). The corresponding trajectory is called regular 
trajectory. 



From Lemma III. 61 and Definition III. 51 we immediately get 
the following corollary. 

Corollary O.7. For z G T Endpo{u) 0(p ), we have 

<ffind p »z = $ P0 , z . (21) 
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Definition II.6. For u G %, the non-negative symmetric Lemma III.l. For u G W, we have 
matrix called controllability Gramian of < fl~3T > is defined by 



G{u) := dEnd Po (u)dEnd* (u). 
The following fundamental property holds. 
Proposition II.8. For all z G T Endpo ( u )0(p ), we have 
(z,G(u)z) Endpo{u) = ||dEnd^(u)z||^ = ||$ Po , z ||«, 

and 

rank dEnd po (u) — dim O(po) G(u) is positive definite. 

For later use, we finish this section by giving the second 
derivative of End pn (-) at u in the direction v G H. 



VJ(u) = dEnd* (u)VJ(End Po {u)). 



(26) 



e? 2 End po (it) : 



End P() (u)C(Po) 



w n> d 2 End po (w)(u, u) = r\,(T) 



(22) 



where, for every v £ H, r v : [0,T] n> TO(po) is the solution 
of the second variational equation 



Proof of Lemma \IlI.l\ Given u G H, for any v G "H, we 

have 

dj(u)v = dJ(End po (u))dEnd po (u)v 

= (V J (End Po (u)), cZEnd Po (w)w} En d P0 («) 
= ((ffind; o (u)VJ(End Po (u)),«) w . 

By defintion, we have 

VJ{u) = dEnd p »VJ(End p »). 



Algorithm 1 Gradient Flow 

(i) Choose an arbitrary control uo G H. 

(ii) Solve the following initial value problem 

dH , , ,„ , , , 

-(«) = vj(n( s )) 



r(f) 
r(0) 



[iro+u(*)ffi,r(t)]+u(t)[ffi,y„(t)], tG [0,T], 
0, 



ds 

ri(o) 



(27) 



u 



(23) 

with y v (-) denoting the solution of the first variational equation 

<m. 

The following lemma is straightforward. 

Lemma EL9. If [/(•) : [0,T] ^ SU(n) satisfies 

17(f) = (Ho+u&H^Uit), te[0,T], 
U(0) = Id, 

then, r,(-) : [0,T] ^ T0(p o ) given by 

r v (t) = U(t)[ [tf(s)HxU(s),z v (t)]v(s)ds £/(*)+, (24) 



with z„(-) 
<|23). 



or more precisely, 

dEnd; o (n(.s))VJ(End Po (n(.s))) 

n(o) = u 



(28) 



Before giving some preliminary analysis on the algorithm, 
we first explain how to compute the right-hand side of Eq. 



[U' ! (s)HiU(s), po])v(s)ds is the solution of 



Corollary 11.10. There exists a contant C > depending on 
Po, Hi, T such that for all u G H, we have 

\\d 2 End po (u)(v,v)\\ < C\\v\\ 2 Hl V v G H. (25) 



III. Gradient flow in % 

A natural idea to tackle Problem 1, which is an optimization 
problem in the infinite dimensional control space H, is to 
follow the gradient of J as an ascent direction in order to 
increase J. The purpose of this section is to present in a 
rigorous way a gradient-type algorithm widely used in the 
quantum chemistry and NMR communities, see for example 

ma, o, ma. 

A. Description of the method and some general properties 

We first compute the gradient of J. Note that J(u) = 
J(End po (u)). 



Lemma III.2. For u G H, we have 

dEnd po (u)VJ(End po (u)) 

= -tr {\po,U{T)^9U{T)]XJ^{t)H x U{t)), 

where U(-) satisfies 

' U(t) = (Ho+utyHJUit), te [0,1], 
J7(0) = Id. 

Proof of Lemma 17/7.21 By Corollary III. 71 it is equivalent 
to compute $ Po , V j(End PO («))■ Eq. d20j implies that 

*p ,VJ(End P0 (u)) 

= (VJ(p(T)), U(T)[U(tf Hl U(t), popp)*) p{T) 
= (\po,U*(T)[p(T),0]U(T)], {U^H^itlpo})^ 
-(zd Po [ Po ,U\T)6U{T% ad^U^HiUit))^. 

We note that [p , U\T)BU{T)] G p. In fact, we have 
[Po,~f] 6 P f or all 7 6 c ,ixn . Indeed, let w G 
h. By definition of h, we have [/>o,w] = 0- Since 
ti([p ,-f]uj) = -tr(7[/3 ,w]), we get [p ,j] G p. Therefore, 
by the definition of {;-} po , we have $ Po . v ./(End PO («)) = 
-tr ([p ,C/(T)t^(T)]C/t( t )H lC /( t )). . 

Proposition III.3. The initial value problem defined by Eq. 
has a unique solution which is globally defined for all 
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s > 0. 



Proof of Proposition \III.3\ The uniqueness and local 
existence of solution for Eq. d28l ) is straightforward. If u is 
not a critical point of J, since U(-) G SU(n), Lemma uTI.21 
implies that there exists a constant C > depending on po, 
6, H\, and the final time T such that 

\\VJ(u)\\h<C, VueH. (29) 

Then, by Cauchy-Schwartz inequality, we have 

d\\n(s)\\n U(s) dU(s) 

ds l ||n( s )|| w ' jw - 

Finally, Growall inequality implies that 

\\H(s)\\-h < Cs. (30) 

Therefore, the solution of Eq. (f28T > is globally defined on 
[0,oo [. ■ 



B. Characterization of critical points 

Proposition III.5. A control u G % is a critical point of J7" if 
and only if 

VJ(End pr ») G Kernel (dEnd* (w)), (32) 

which is equivalent to 

VJ(End pr ») 1 Image (dEnd p »), (33) 

where the orthogonality symbol _L is taken with respect to the 
inner product {•, -)Endp (M)- An equivalent condition is that the 
switching function $ POj vj(End PO (ji))(') ls equal to zero almost 
everywhere on [0,T]. 



Proof of Corollary \III.5\ 
It suffices to note that the kernel of dEnd* o (u) is equal to 
the orthogonal complement of of the image of e?End po (u) with 
respect to the inner product {•, )End P0 («)- The last condition 
comes from Corollary III. 71 



Proposition III.4. Given uq G 1-L which is not a critical point 
of J, the solution of Eq. (l28l i starting from uo converges to 
a connected component of the set of critical points of J as 

s — > +oo. 



Proof of Proposition \III.4\ If uq is not a critical point of 
J, then 



= \\VJ(ll(s))\\ 2 H >0. 



(31) 



Since O(po) is compact, the real-valued function J defined on 
O(po) is bounded. Therefore, J = JoEnd po is also bounded. 
( 1311 implies that lim J{Jl{s)) exists. 

We now show that dJ(R{ s )) ^ uniformly continuous. 
By Corollary III. 51 Eq. d29l , and Corollary III. 101 respectively, 
End pn (-), II(-), and G(-) are all Lipschitz functions, they are 
therefore uniformly continuous. As VJ(-) is a continuous 
function defined on the compact set O(po), it is also uniformly 

continuous. Therefore, is uniformly continuous as 

composition of uniformly continuous functions. 

dJ(ir(s)) 

Since lim Jiirls)) exists and ; is uniformly 

s->+oo ds 
continuous, Barbalat's Lemma implies that 

lim g£Cg» = 0. 

In other words, II( ) converges to a connected component of 
the set of critical point of J . 



Proposition 1111.51 together with Lemma 1111.21 implies the 
following more explicit characterization. 

Corollary III.6. A control u G H is a critical point of J if 
and only if 

tr {[ Po ,U{T)^eU{T)]U\t)H 1 U{t))=Q, for t G [0,T], 

(34) 

which is equivalent to 

ti (\p{T),e]U(t-T) f HiU(t-T)) =0, foriG[0,T]. (35) 

The following properties are straightforward. 

Corollary III.7. Consider u G If End po (w) is a critical 
point of J, then u is a critical point of J . 

Corollary III.8. If u G H is a regular control, then u is a 
critical point of J7" if and only if End po (u) is a critical point 
of J. 

For later discussion, we distinguish two types of critical 
points. 

Definition III.l. A control u G H is a kinematic critical point 
of J if End po (w) is a critical point of J. All other critical 
points of J are called dynamic or non-kinematic critical point. 

Remark III.2. We note that dynamic critical points are neces- 
sarily singular in the sense of Definition III. 31 while kinematic 
critical points can be either regular or singular. In the absence 
of singular controls in W, all the critical points of J are 
kinematic and regular. We also note that the dynamic critical 
points are necessarily not solutions for Problem 1, see Remark 



Remark III.l. The above result only guarantees the con- 



C. Analysis in the absence of singular controls 

The standing assumption of this section is the following: 



vergence of II(-) to a set of critical points but does not (H2 ) the controls in H are regular (Definition 
directly imply the existence of lim II (s). We need further 



information about the set of critical points of J . 



Although (H2) seems restrictive, it allows us to give a com- 
plete analysis of the asymptotic behavior of d27] i in accordance 
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with existing numerical simulation results. The goal of this 
section is to prove the following result. 

Theorem III.9. Under (HI) and (H2), every solution of the 
gradient flow (|27| | converges to a critical point of J as s — > oo. 
Moreover, for almost all initial conditions, the solution of (l27l > 
converges to a solution of Problem 1. 

We start by giving a more precise characterization of the 
set of critical points of J under (H2). For ease of notation, 
the kernel of dEnd Po (u) and the image of dEnd* Q (w) will 
respectively be denoted by K u and I u . 

Proposition 111.10. For i = l,...,M, let H t := {u e 
H, End po (u) = pi}. Under (H2), we have 

(i) the set of critical points of J is the disjoint union of Hi 
with i = 1, . . . , M; 

(ii) "Hi's are submanifolds in H of co-dimension N; 

(iii) The tangent space to Hi at u G Hi denoted by T u Hi is 
equal to K u . 

Proof of Proposition \III.10l (i) is a consequence of MI. 81 
and the fact that J has only isolated critical points. For all 
u G H, dEnd po (u) has finite rank, thus its kernel splits. By 
(H2), End po (-) is a submersion from H to O(po) (cf. Ifl9l 
Prop. 2.3, p 29]). Therefore, by the Submersion Theorem, the 
set End^ (p^ is a submanifold in H of co-dimension N, and 
T u Hi =K U (cf. H Th. 3.5.4, p 175]). ■ 

By computing the second order Taylor expansion of J, the 
following result holds true. 

Lemma III.ll. For u G Hi, the Hessian of J at u is given 
by 

A(u) := dEnd* (u)V 2 J(p t )dEnd po (u). (36) 
Proposition 111.12. For u G Hi, we have 

(i) the kernel of A(u) is equal to K u ; 

(ii) the number of positive (resp. negative) eigenvalues of 
A(u) is equal to the number of positive (resp. negative) 
eigenvalues of V 2 J(pi). 

Proof of Proposition \III.12\ For (i), let v G 
H. Since dEnd* o (u) is injective, A(u)v = implies 
V 2 J(pi)dEnd po (u)v = 0. By Lemma Hi. 3 1 one gets v G K u . 
The converse is clear. For (ii), we first note that by (H2) and 
Lemma Hi. 31 the image of A(u) is equal to X u . Let g(u) be 
the positive definite symmetric matrix such that g 2 (u) = G(u) 
(see Definition III. 61 ). We set 

a (Pi) : = g{u)V 2 J(pi)g{u). 

Since g(u) = g T (u), by Sylvester's law of inertia, a(pi) and 
V 2 J(pi) have the same numbers of positive and negative 
eigenvalues. Let {vk}k=i....,M be the set of eigenvalues of 
a(pi) and {pk}k=i,....M be the corresponding set of orthonor- 
mal eigenvectors. For k = 1, . . . , M, let 

v k := dEnd* (u)g(w)^Vfe- 



Then, it is clear that the set {v k } k =i m forms a basis of I u . 
Moreover, we have, for k = 1, . . . , M, 

A{u)v k = dEnd* o (u)V 2 J(p i )G(u)g~ 1 (u)p k 
= dEnd* o (u)V 2 J(pi)g(u)p k 
= ;y fc dEnd* o (it),9 _1 (it)/i fc 
= v k v k . 

Therefore, the non-zero part in the spectrum of A(u) is equal 
to the spectrum of a(pi). We conclude that V 2 J(pi) and the 
restriction of A(u) to I u have the same signature. 

■ 

As a direct consequence of Lemma III. 31 and Proposition 
1111. 1 21 we have the following result, which, together with 
Proposition IIII. 12l will play a crucial role in the convergence 
analysis of dTH ). 

Corollary DL13. 

(i) For u G H\, A{u) restricted to X u is positive definite; 

(ii) For u G Hm, A(u) restricted to I u is negative definite; 

(iii) For u G Hi with i = 2, . . . , M — 1, A{u) restricted to 
I u is not definite. 

Based on (i) of Proposition IIII. 121 the following result 
is a generalization of the classical Morse Lemma (see for 
example lfl9l Ch. 7, Th. 5.1]). For functions defined on a finite 
dimensional manifold, a result similar to Proposition IIII. 1 4-1 is 
known as Morse-Bott Lemma. In fact, the following result 
deals with the case where critical submanifolds are of infinite 
dimension. For the sake of completeness, a proof will be given 
in Appendix. 

Proposition 111.14. Let C be a connected component of Hi 

and u c G C. Then, there exist an open neighborhood U of u c 

± ± 

in H and a smooth chart : U i-> H = V\ ® V 2 © K. such 
that 

(i) the dimensions of V\ and V2 are equal to N{ and N — N[ 
respectively, where N[ is the Morse index of u c ; 

(ii) 4>(u c ) = 0, and 

4>{Ur\C) = {(vi,v 2 ,w) EVixV 2 x]C, vi=v 2 = 0}; 

(iii) J o4>- 1 {v 1 ,v 2l w) = J(u c ) - + \\v 2 \\ 2 n . 

Remark III.3. By Corollary IfflJJl Nf = 0, < N{ < N, 

for i = 2, . . . , M - 1, and Nf* = N. 

Remark III.4. The gradient flow defined by J and the one 
defined by J := J o are equivalent in the sense of iff] 
Theorem, Ch. 1, Sec. 5.3]. The diffeomorphism <fr provides us 
with a suitable change of coordinates and allows us to simplify 
the expression of d27l i. 

Once we have Proposition lHI. 141 the proof of Theorem lIII.9l 
is a straightforward adaptation of the proof sketch of [13 Prop. 
3.6, Ch. 1, p 20]. 

Proof of Theorem MIL 9\ We know from Proposition IIII. 41 
that the flow converges to a connected component C of Hi 
for some i G {1,...,M}. Fix an arbitrary u c G C and 
consider a neighborhood U of u c small enough . Without loss 
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of generality, if II(-) is the solution of ( f27b . we can assume that 
II(so) G U for some sq > large enough. Using the change 
of coordinates introduced in Proposition IIII. 141 and taking into 
account Remark 1111.41 the gradient flow of J starting from 
II(so) is equivalent to the gradient flow of J o in a 
neighborhood of C, 



i'2 

w 



"2- 

0, 



(37) 



where (v x ,v 2 ,w) G Pi x V 2 x K and (vi(0), v 2 (0) l w(0)) = 
<fi(H(so)). The solution of (l37l i will be denoted by II(-). Two 
situations can happen: 

(i) if </)(n(,s )) = (vi t o, 0, w a ) for some ui )0 G Pi and w £ 
/C, then lim Il(,s) = (0,0, wo), which implies that 

lim n(s) = (j)- 1 (0,0, w ) S 

(ii) if 0(n(s o )) = {vifl,v 2 ,o,w ) with w 2j o 7^ £ f 2 , then 

lim fi(s) = +00. (38) 

s— ^00 

This case requires that V 2 be a subspace of dimension 
greater than 1, i.e., C is a connected component of Hi for 
some i G {1, . . . ,M — 1}, see Remark IIII. 31 However, 
if this case happens, d38l implies that II(-) does not 
converge to C. Therefore, C is necessarily a connected 
component of Hm- In this case, the flow (l37T i is reduced 
to the following 



vi = 
w = 



-vi, 



0. 



(39) 



where (v±, w) G V\ x /C with dim Pi = iV. The asymp- 
totic behavior of d39l implies that IT(s) will converge to 
an element of C C Hm as s —> 00. 

We conclude from (i) and (ii) that all the solutions of the 
gradient flow of J always converge pointwise. It is also clear 
that for almost all initial conditions, case (ii) happens, i.e., 
almost all the solutions converge to a maximum of J. ■ 

D. Comments on the role of singular controls 

We give in this section a more explicit characterization of 
singular controls for (HJ and then explain some difficulty in 
the analysis of the asymptotic behavior of (l27l i related to their 
presence in H. We first recall the following result which is a 
direct application of Th. 6, p 41] or J27] Prop. 5.3.4, p 94] 
to CQ. 

Lemma 111.15. Let u G % and /?(■) be the corresponding tra- 
jectory. Then, u is a singular control if and only if there exists 
an absolutely continuous application q : [0, T] i-> TO(po)\{0} 
such that 

q(t) = [H + U (t)H 1 ,q(t)}, (40) 

and 

(q(t), [H llP (t)}} p(t) = 0, for t G [0,T]. (41) 

Using Definition III. II and (fTTT i. we have the following 
equivalent characterization of singular controls. 



Corollary 111.16. A control u G H is singular if and only if 
there exists J7q G p \ {0} such that 



tr(ft U\t)HiU(t)) = 0, for t e [0,T], 
with [/(■) satisfying 

" U(t) = (Ho + u^H^Uit), te[0,l] 



U(0) 



Id. 



(42) 



(43) 



Proof of Corollary \III.16\ Assume there exists Do ep\ 
{0} such that Eqs. d42l and d43l are satisfied. Let q(-) be the 
solution of Eq. (l40l starting from q(0) := [po,^o]- Then, we 
have 

q(t) - U(t)[po,n Q ]UHt) 

= P (t)u(t)n u\t) - u(t)n u^(t) P (t) 

= ad p{t) Ad u{t) n . 

This implies 

{ q (t),[H llP {t)]) p(t) 
= -(adp( t )Ad [/(t) D ,ad p(t) Ad [/(t) [/ t (t)i7i[/(t)} p(t) 
= -tr(O (UHm^it))?) 
= -tr(O U^{t)HxU{t)) = 0. 
By Proposition llH. 151 u is singular. The converse is immediate. 



Remark III.5. This result states that a control u is singular if 
and only if the real and imaginary parts of the matrix elements 
of the projection of W (t)HiU(t) on p, where U(-) satisfies 
(14311 . are R— linearly dependent functions of t over the time 
interval [0,T]. 



We note that, according to Corollary IIII. 71 the elements of 
Hi, for i = 1, . . . , M, are still critical points of J called kine- 
matic critical points. However, due to possible rank deficiency 
of the end-point map, the Submersion Theorem may non 
longer be used and Hi may not necessarily be submanifolds 
of H. More importantly, for u G Hi, although the expression 
of the Hessian of J at u given by (|36] l is still valid, the two 
crucial results given in Proposition IIII. 121 may fail. In other 
words, the non-zero part of the signature of A(u) may non 
longer be determined by the signature of V 2 J(End po (u)). This 
is the first complication in the asymptotic analysis due to the 
presence of singular controls. 

The second difficulty is the occurrence of non-kinematic 
critical points of J. We know from Remark |L4] that these 
critical points are not global maxima of J . However, nothing 
a priori prevents them from being local maxima and then 
"attracting" solutions of ( 127) . Although this situation has never 
been observed in numerical simulations, a formal proof is still 
missing. A complete spectral analysis on the Hessian of J 
needs to be performed. We note that if u is a non-kinematic 
critical points of J, the Hessian form of J at u is given by 

V 2 J{u)(v,v) 
= {v,A(u)v) n + (\7J(p),d 2 End po (u)(v,v)) p , 

where v G H and p := End po (it). 



(44) 
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IV. Conclusion 

We presented in this paper a gradient-type dynamical system 
to solve the problem of maximizing quantum observables 
(Problem 1). Under the regularity assumption on the controls 
(H2), we proved that for almost all initial conditions, Eq. 
( |27| | converges to a solution of Problem 1. We also detailed 
difficulties related to the presence of singular controls, which 
constitute the starting point for further investigations. From our 
point of view, one first needs more explicit characterization 
of singular controls, then deduces information on the "size" 
of the set of singular controls S in the entire control space 
L 2 ([0, T], R). The next step is to investigate the optimality 
status of a "generic" elements of S. Finally, let us also 
emphasize that upon due care to numerical details, simulations 
for extensive systems always achieved the global maximum. 

Appendix 
Proof of Proposition UlLlll 
We first note that Morse-Bott Lemma are often stated 
without proof as a direct consequence of Morse Lemma. A 
complete proof of this result for functions defined in finite 
dimensional vector spaces can be found in [31 ■ We will see 
in the following that dealing with infinite dimensional critical 
submanifolds presents no difficulty. 

Proof of Proposition \III.14\ Let C be a connected 
component of Hi and u c G C. Since Hi is a submanifold 
of H of co-dimension N, there exist a neighborhood U of u c 

in H and a smooth chart ip : U \-> H = V © K such that 

• the dimension of V is equal to N; 

. <p{u c ) = 0, and ip(U n C) = {0} x K. 
Fix w G K, in a neighborhood of 0. Proposition IIII.12I implies 
that the Hessian at of the new functional J w defined by 

Jw(v) := J O (y5 _1 (w, W) 

is non degenerate on V. Note also that the signature of the 
Hessian of J w at is equal to the one of the restriction of 
A(u c ) to Iu c . Applying Morse Lemma (cf. OH Ch. 7, Th. 
5.1]) to J w , there exists a smooth change of coordinates ip w , 
t)i->a;:= i/j w (v), such that 

J w {^-\x)) = (Ax,x), 

where A is a symmetric matrix which has the same signature 
of the Hessian of J w at 0. Note also that ip w depends smoothly 
on w. 

Let <p(u) — (ipi(u),<p2(u)) G V x K, and <f> be the new 
smooth chart for C in a neighborhood of u c defined by 

4>{u) := (1>w(u)(<Pi(u)),<P2(u)). 
Then, by construction, if x = <j>(u), we have 

Jof 1 ^) = (Ax,x). (45) 
Proposition IIH. 141 follows from (l45i ■ 
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